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ABSTRACT 


Stirling’s formula is one of the most frequently used results from 
asymptotics. It is used in probability and statistics, algorithm analysis and 
physics. In this thesis we shall give a new probabilistic derivation of Stirling’s 
formula. Our motivation comes from sampling randomly with replacement 
from a group of n distinct alternatives. Usually a repetition will occur before 
we obtain all n distinct alternatives consecutively. We shall show that 
Stirling’s formula can be derived and interpreted as follows : as n--->o the 
expected total number of distinct alternatives we must sample before all n are 
obtained consecutively is asymptotically equal to the expected number of 
attempts we make to obtain all n distinct alternatives consecutively times the 


expected number of distinct alternatives obtained per attempt. 
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L INTRODUCTION 


A. THE PROBLEM 
Asymptotic analysis is important in many areas of modern science, such 
as the theory of probability, complex analysis and applied mathematics. 
Because the factorial function and its asymptotic behavior are often 


needed in mathematics and engineering, Stirling’s formula 


nt! ~ ne V2nn, (n---->©), (1) 


is one of the most important and frequently used asymptotic formulas. The 
notation in (1) means that the ratio of the left side and the right side tends to 
one as n tends to infinity. 

There are several ways to prove Stirling’s formula. For example, one can 
take the logarithm of n! and use Wallis’s formula to obtain the factor of 
(x )1/2. For this type of proof, see [Ref. _1 ]. 


Alternatively, one can start with the integral representation 


and use Laplace’s method for integrals to evaluate it asymptotically. 
see [ Ref. _2 ] for this type of approach. 


All these methods use many techniques from mathematical analysis and 
some of them are quite sophisticated. We will pursue a new way to prove 
Stirling’s formula using a discrete or combinatorial approach. 

This method of proof was mentioned as a research problem in [Ref._3_], 


and the purpose of this thesis is to present a solution to this problem. 
B. MOTIVATION 
From (1), Stirling’s formula can also be written as 


n! V2nn e° 


~~ SG) > ), 


Imagine a box filled with n distinct balls. We shall select balls at random 
with replacement. The motivation for our approach comes from noting that 
n!/n" is the probability of selecting n distinct balls consecutively while 
(2mn)'/2/2 is the asymptotic expected number of distinct balls obtained 
before a repetition as n—>oo. These expressions appear in Stirling’s formula 
as written above thus indicating that a combinatorial proof might be possible. 
The purpose of the next section is to define the combinatorial set up in more 


detail. 


IL COMBINATORIAL SET UP 


A. DEFINITION OF THE GAME 

Imagine a box filled with identical balls numbered from one ton. We 
draw a ball from the box at random, write down its number, and replace it, 
mixing the balls well so that our next draw is also made at random. If we 
continue this process we will eventually get a repetition for there are only n 
distinct balls and we must certainly repeat a number by our (n+1)$' draw. 

We are interested in the task of drawing out all n balls consecutively in 
this manner. We mean by this that after n consecutive draws, recording the 
numbers as we draw, we wish to obtain a permutation of the sequence (1,2,3, 
... M). If we obtain a repetition before the desired result, then we start over 
from the beginning. 


The following three questions are of interest: 


e What is the average or expected number Ey of distinct balls obtained 
before a repetition occurs? 


e What is the average or expected total number Ty of distinct balls 
(adding up the number of distinct balls obtained in the first game, the 
second game ... etc.) selected before obtaining n consecutive distinct 
balls (i.e., some permutation of (1,2,3, ... ,n) ). 


e What are the asymptotics of En and Ty as n--->¢0 ? 


B. THE AVERAGE OR EXPECTED NUMBER OF DISTINCT BALLS BEFORE 
A REPETITION 


Let pj be the probability that we get exactly j distinct balls before a 
repetition. In other words, since only j distinct balls are obtained, pj is the 


probability of getting a repetition on the (j+1)S' draw, and not before. 


Since we assume each draw is independent, the probability of drawing a 
specific ball at any time is just 1/n. We always obtain at least one distinct ball 
in any play of the game. To obtain exactly one distinct ball in a game we must 
get a repetition on our second draw. The probability of doing this is 1/n and 


therefore the probability of obtaining only one distinct ball is 


— 


|. 


=| 


The probability p, also can be written as 


nv 


om 


3 | 


To draw two distinct balls before a repetition we must get distinct balls 
on both the first and second draws. The third draw must then be a repetition 
of either the first or second draw. Thus we are looking for a three-tuple 
where the first two elements are distinct and the third element is a repetition 
of either the first or second element. Since all elements come from 
{1,2,3, ..., n}, there are a total of n° three-tuples, with only 2:n-(n-1) meeting 


the above requirement. Therefore, 





sual ele 
P2 On n 
In the same way, 
n-O n-1 n-2 3 
P30 See Sean 


and clearly 





Since 


| 
= | 
=) 
— 
— 
— 


j (n) (n-1) ... (n-j+1) 
j+l 





7 
setting j=n gives 
n-O n-1 n-2 n-3 n-n+1 n 
Po ~ On n n n on 
n! 
~ on 
mn. (2) 
For j=n-1, 
tie eae 2 eee n-(n-1)+1 n-1 
Pat ~ yy n en n n 











n-1 n-2 n-3 2 n-1 
ree 


(n-1)(n-1)! on 
n-1 n 
n 


(n - 1) (n)! 


























n 
n 
and for j =n-2, 
—_ n-l n-2 n-3 n-(n-2)+1 n-2 
Pn-2 = yy n ie n n 
—_ n-l n-2 n-3 3 n-2 
on n n "'n on 
(n - 2) (n-1)! 
na 
n(n-2) n! 
2 on 
n e 
In general, for 0<j<n-l, 
oe nelpn =a n-(n-j)+1 nj 
Pnj ~ y n n 7 n n 
(n - j) (n-1) (n-2)...G+1) 
n-j 
n 
(n - j) (n-1) (n-2)...G+1) no? jt 
Nn-j j! 
n n 


We shall now sum each pj from pp to pi in reverse order beginning 


with 
n! 
Pont Pn-1= [1 + (n-1) J aes 
n 


nn! 





Continuing, 


not. 1 


Pat Pn-1 7 Pred o> = = 


a 2n+n°-2n n! 
= 3 


and 


2 D1 
n n! on (n-3) nl! 
Pat Pn-it Pn-2*Pn-3 = 4 om, 2 ae 


n 


a Gal +n? -3n" n! 
a Meek 


We claim that 


n! n! 
Pot Pait--+Pnj = — 7 (O<j<n-l). 
n 


We can prove this by induction. Assume 


Pot Pyh-it---+Phae = = 155 


for some k < n-1. This is the induction hypothesis. It holds for k = 1, 2, and 3. 


Then 
Pot Pp1t--- + Pn-+ +P n-(k+1) 
_nont yal kl) at 
an k! (k+1)! a 
_ni n* 1+ (n-k-1) 
wan kr 1) * (ee | 
ni n n 
sme Ve 
n 
k+] 
_nm Nn 
7 a (k +1)! 
This proves 
. n! 
Pn-k = Pnt Pn1t--- + Pn; = —~ FT > 0 <j < n-l. 
n J: 
(3) 


k=0 


Equation (3) now implies 





n n-l 
ine = Pn-j 
k=] j=0 
nf! n™! 
1s (n-1)E 
—an 


What is the expected number E, of distinct balls obtained before a 


repetition? This expression is 


n 
E, = Di kp, = py +2p2t3p3+...+np, 
k=1 


Pi +P2t+p3t...+ Pp 
+ Do pace... + DP, 


Tap aahses + Pe 


+ Pn 


el pie a G@leqepey here +1 p] -p>---- Py). 


From (3), 


ae Posey = Pj+1* Piya +--+ Pa 


‘<a 
os Pn-k 











k=0 
a SUEY 
_ an (n-G+))P 
n-1 n- n-j 
= oe EE, e_ A <4. He 
2 ee (lsj<n-l). 
Thus 
Boo 1+ 0) ee eee ee 
n n n n n n 


(4) 


C ARELATED GAME 

Now we consider a related game to simplify our later analysis. The rules 
for this new game are as follows: initially, we start with n distinct balls. Now, 
however, when we select a distinct ball and replace it, we also add a new ball 
numbered differently from all previous balls. For example, suppose we have 
just selected the kth distinct ball. Before our next draw, we replace the kth 
ball and add a new ball numbered n+k, so that our next draw will be from a 
pool of n+k equally likely distinct balls. Thus, each time we draw out a 
distinct ball, the number of balls in the box increases by one. 

This game, like the previous one, ends when we get a repetition. 
However, unlike the first game, now it is possible in principle to obtain 


arbitrarily many distinct balls. 


10 


If the game ends, we empty the box and start over with the original n 
balls. 

Now, what is the expected number of distinct balls E,” obtained when 
playing this second game? 

Let pj be the probability that we draw out j distinct balls, ie., repetition 
occurs on the (j+1)st draw, and not before. 

Thus p; is the probability that a repetition occurs on the second draw. 
Since we always get a distinct ball on the first draw, after the first draw, the 


box has n+1 balls. Therefore, 





7.’ 
Pro antl” nel. 


In the same way, p2° is the probability that a repetition happens on the 
third draw, and not before. Therefore the first and second draws yield 
distinct balls so that after the first draw there are n+1 balls in the box, and 
after the second draw there are n+2 balls in the box. The probability of getting 
a distinct ball on the second draw is n/(n+1), and in order to get a repetition 
on the third draw, we have only two choices out of n+2 balls in the box. 


Therefore 


ee meee 
P2 ~ font] nt2. 
In the same way we find 
: nn on 3 
a Se re era Y 
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oe ee ee 
Pj * f ntl n+2 n43 " ntj-1 n+j 


Again we need to show that the sum of all probabilities is one. We argue 
as follows. 


“ot ee 
Pi aen mel 


== 


= oe 


n+1 | 


non 2 
n n+l n+2 


n 
n+1 


P; +p2 = (1- yee ( ) 


n 


n 3 
ge ar) Gay UO ey 
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We claim 
k an 
Di LS Gi GO TS 


This is true for k=1. 


Assume for the induction hypothesis that 





m n 
2?) as (n+1) (n+2) ... (n+m) 
Then 
a eee rey ee: 
mo Pm+i = (n+1) (n+2) ... (n+m) n ntl n+2 °°" nt+m n+m+l 
ey 4 n- n- m+l 


(n+1) (n+2)...(ntm) ~ (n+l) (nt2)...(ntm) n+m+l 


n- m +1 
= Es WassiNcinD) ean GET) pe eaTEEL” 


m +] 
n 
t= (n+1) (n+2) ... (n+m) (n+m+1) 
This concludes the induction proof. 


Note that the expression 
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k ke 
° n 
2°; a! GEMGD) ial) 


can also be written as 


k k 
n 
1- 20; = aly ae? 
fl J (n+1) (n+2)... (n+k) 5) 
Now let us consider 
lim i 


2) Ges 


lim 1 
k—>oo 1 2 k 
(1 + =) (1 + =) oe (i? 


Since 
> 00 as k-—> 00 


4 





ee 
n 


it follows that 


im aK) 
k—>oo (n+1) (n+2) ... (n+k) 


Letting k--->eo in (5), it then follows that 


nae . k 
>P;" = we) ay 
= i 


_ lim ne 


= ol (n+1) (n+2) ... (n+k) 
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_,. lm ne 
~  kpeo (+1) (n+2) ... (n+k) 


Now we shall find the expected number Ep’ of distinct balls for this 


second game. The expected value Ep’ is 


mM: 


E,° = kp, = p, +2p2° +3p3° +... 


k=] 


= PietePo t Pact Pant ..- 
+Ppo°+p3°+py't... 
+p3° +p, '+ ee 


+ D4 Piel. 


=1+(1-p,°)+[01 -(Cp,' + po’ )] +...+01 - (py + po’ t+... + pj) +... 


(6) 


Note that to derive (6) we have used (5). 
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D. ASYMPTOTICS FOR THE TWO GAMES 


We shall now study the expected values of the two games. 


No closed 


form expressions appear to exist for En and En’ as given in (4) and (6). 


However our proof of Stirling’s formula, as mentioned in the introduction, 


requires the asymptotic behavior of En as n--->e. In this section we shall 


study the asymptotic behavior of En and E) . 


Recall that 





























t n-1 n-1n-2 n-1 n-2 
E, = Zane ts saat =a! aaa = 
and 
= 0 So 
va = 2k Ps Lory : n+1 n+2 : n+l n+2 n43 
Let 
n-QO n-1 n-2 n-k 
a, = 
n n n n 
B, = Bee — 
k n+0 n+1 n+2 n+k 
Then ( 4) becomes 
nl n-1 
E, - 9 oe Oy 
k=1 k=0 
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— 9 oe 


(7) 


(8) 


(9) 


while (6) becomes 


k=] k=0 (10) 
We are going to show that 
n-1 = 
> a, ~ >’ B, as N---> 0Oo 
k=0 k=0 


OT 


E, ~ E,", (n--->©). if 


We shall do this in several steps which will be given in sections 1 through 4. 


1. An Inequality for E, anda Partial Sum of E,” 
The goal of this section is to obtain (15), an important inequality 
relating Ep toa partial sum of E,’. 


To accomplish this, there is an inequality we shall need. It is 


lee <= ee aa x>0Q. 
1+x (12) 


We prove the inequality (12) as follows : 

If x > 0, then -x< 0. By exponentiating both sides we get 
eX < 1, or 1-e*X>0. 

If x < 0, then -x> 0. By exponentiating both sides we get 
eX > 1, or 1-eX<0. Define I(x) by 
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I(x) = fa-e54 


From the above inequalities, we conclude that 
I(x) > O, if x40. 
However , 


I(x) = tte” 


= xt+e-1. 
Consequently 


el > 1-x, x0. (13) 


Note that equality occurs in (13) only if x = 0. When x 2 0, this 
expression yields the first inequality in (12). 
For the second inequality in (12), we note that (13) implies eX 2 1 + x, 


(x20), or eX <1/(1+x), (x20). Returning to the problem, from (7) and (12) it 


follows that for 0< k <n-l 


Q 
ne 
It 


0 ] 2 k 
(1-=)(1- —)(1-=)...(1-5) 


-0.. =i) eo -k 
be] nD be] 0 


IA 


€ e CC .-. Ge 
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n+1 n+2 n+3 °° n+k 


By 


Therefore, 


-k (k+1) 


re eceee pe. 2 (OS ke=n- 1): (14) 


Summing the inequality in (14) we conclude that 





k=0 k=0 k=0 (1 5) 


n, (16) 
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2. The Divergence of E, and E," 


We shall need the following inequality, special cases of which will be 
useful later. This result is given as an exercise on page 60 of [Ref._4 ]. 
If pj >-1 for i=1,2,..,m where m>1 and wy, Wy, ..., Um are all 


positive or negative, then 


m 


Th(1+hj) > 1+ Doni 
i=] i=l (17) 


We shall prove this by induction. For m =2 the inequality holds since 
C1+py) C1 +H2) = 1+py thot bite 
> 1+pyt+po. 


Assume the inequality is true for m=k, i.e, 


k k 
T[](1+p;) > 1+ Dib 


i=l i=] 


This is the induction hypothesis. Multiplying both sides by 1+ ,,., > 0, 


we have 
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k+1 k+1 k 


Tl (1t+n;) > 1+ Mutua dy; 


<3] i=] i=] 


k+1 
> 1+ » LL; 
i=] 


The above inequality holds because all jj are either positive or negative. 
This completes the proof. 


Since 
0 
a, = (-—)(1- 4) (1-2)...(1-£), (Osksm-1), 


Clearly 
with &, = 1 only whenk = 0. 


We claim that 


L 


1 k k 
eae Se ie mess < < ne 
(1 Te C1 air (> +...+7), (1<k<n-l). 


This follows from (17) with pj = -i/n and m=n-1. Inthis case -1 < pj <0 
for 1=1,2,...,n-1. Using the definition of a, and admitting the case k = 0, 


we conclude 
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] - ¢: + a4 ...+8) <a, 5s), (vSeen-!): 


Since 


0.1 k k(k +1) 
—+—+...¢= = — 
n on n 2n 
(18) may be written as 
y- 2D es 1,(0<k<n-1). 


It follows that if k? = o(n) as n--->e° (i.e., k?/n--->0 as n--->ce ), then 


a,—--> 1 as n---> co, 


So, for example, when k < n!/4 


Ca as N---> 9, 


This implies Ep --->2, as n--->ee, and since 
E.* >E 


n n 


by (16), it follows that E,°--->ce0 as n--->00 too. 


» (18) 


Thus, in both games the expected number of distinct balls obtained 
before a repetition occurs tends to infinity as the initial number of balls in the 


box tends to infinity. 


3. The Leading Asymptotic Contributions to E, and E," 


In this section we shall show that 
k, ky 
| » Oy, ear » Be, (n--->c9), 
k=0 k=0 


when 


This result determines the leading asymptotic contribution to Ey and Ey’, 


In order to show this, we shall need Bernoulli’s inequality: 


(l+x)" > 1+mx, ifm>1,x>-land x#0. (19) 


Bernoulli’s inequality is a special case of the inequality in (17). 
Choose pj =x for i=1,2,..,m when x#0 and x >-1. Then (17) implies 
(19). 

Using (19) for any positive integer k with 2< k<n, (1- 
k/n) < (1-1/n)k, and (1-k/n) =(1-1/n)k, fork =1ork=0. 


Now we define 


1 
a 


ge a? | (0<e<Z). 


(20) 
lye 
The number ky is the largest integer less then or equal to n’ ie, 
lie lee 
(n? -1)<k,<n’ 
If k>ky, and k isan integer then 
n? <k,+1<k 
so that 
a rs de 
— >n ,ie, — < -n 
(21) 
Recall that 
n-1 ae 
E, = B, + » B, 
k=0 k=n 
If k >n, 
p= tt ee 
kK nt+0 n+] n+2 “ntn 2nt+] “° 2n+k-n | 
so that 
ike 
B.S (>) 
Consequently, 
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il 
Zé 
Se 


(22) 


n-1 
Since E,,” diverges, it follows that E,” ~ y B, » (n--->). 
k=0 


Now, fork < n, 


B _~ A Aa A 
k ~~ n+0 n+1 n+2 °°’ n+k 


0 ] v4 k 
= Oo OO nT One” ak? 


0 1 2 k 
S 1-5) 0-5) 1-2)... = =) 
0 1 2 k 
S (I-5-) (l-se) (1-3) ...L- 3) 


by (19). Since the right side of the above inequality can be written as 
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1 0+1+2+...+k 


em 


and 0+1+2+...+k 


= k(k+1)/2, it follows that 


k&k+1) 
jon 

< = 
B. <1 re 





This inequality implies 


fie 


I! 
< ae 
p, $1 2n 


2 
a 
2 


5 
(e2")?, (by(12)) 


lA 


Since (21) implies 





for ky, < k <n, it follows that 


2¢t 


B,<e, (Kk on ). 
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Now recall from (14), that when k < n-1 
a, S By. 


Combining the last two inequalities then yields 


2¢ 
-n 


mea pee, (k, < k <n). 


It then follows that 


n-] n-1 n 
»y OS »y Bes LS 
k=k,+1 k=k +1 


2e 


; (23) 


(24) 


aS N--->09, 


Recall that 
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Since Ej, --->ee as n--->eo and the second and third sums in the above 


expression are finite by (22) and (24). It follows that 


k, 
EL ~ >» By. (n--->ee ), 
nae (25) 


Similarly, 


k, n-1 
E,= mom > oO 


k=0 k +1 


since Ey also diverges as n--->ce, and the second sum above is finite 


by (23), as n-—->eo we conclude 


k, 
E, ~ 5 eases. 
k=0 (26) 
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4. The Proof that E, is Asymptotic to E,’ 


From the above analysis, we conclude that 
k, k, 
ees aE ¥ p,, (2—>~). 
k=0 k=0 
We shall now show that 


ke 
Yo, ~ YB, (n>), 


k=0 k=0 


or from (9) and (10) that 
E, ~ E,” as n--->e0 


thus proving (11). 
For 0<k<ky, 


1 2a k 
OK SCL eel —) 


n n 
By Seay) eg) ora) 
n-l . n-2 n-k 
atin) 
= n 


Nn n 
Cd) G42) Ge? 


ict ew eet (ni:k 
eg) ae - 
n n n 


( 





) 
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Z 2 p. 


= (152) YO - (5) ee) 


n n 





k 
Kk? 
> ae (=) ) 
k? 
> oer (by Bernoulli's inequality ) 
n 
3 
— 
2 
n 


From this analysis and (14), it follows that 


3 
k 
B,(1-——) We = Pp (Sake 
n 


Summing the above inequality gives 


ae k, k, k, 
(t=) Zep eee, Me Sy 
n k=0 k=0 k=0 (27) 


By the definition in (20), 


SO 
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Since 0<e< 1/6, it follows that 


5 
n 


2 
n 





--->Q) as N--->eo 


Letting n--->c° in (27), we can conclude that 


k. k. 
dt ~ 2 By» (n>) 
k=0 k=0 (28) 


From (25) and (26), it then follows that 


E, ~ E,’, (n--->e). 
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Ill. STIRLING’S FORMULA 


A. THE COMMON ASYMPTOTIC VALUE OF E, AND E,. 
In Chapter II we proved that 


E, ~ Eq’, (n--->e) 


In this chapter we will determine the common asymptotic value of En 


and E,. 


From (14) we have 


-k(k+!) 


Opec CP same (OSiesno)) 








Hence, 
Kk, k, - k(k+1) k, 
a, S ) cas pe 
k=0 k=0 k=0 (29) 
Letting n--->ce in (29), and using (28) we conclude 
ky ky oe 
oo e772 e227 =| (N--->ee), 
k=0 k=0 
(30) 
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ky k, 4? -& 
YB, ~ DYerme*™ , (n--->e9). 
k=0 


k=0 


Consider the following inequality: 








-kn ok, ek? a k, - k 
e 2n e 2n < e 2n e 2s < y e 2n 
k=0 k=0 k=0 (31) 
Since k,/n = (1) as n--->oo , we conclude from (31) that 
ee a 
e 2n e” sa e 20 ; (n--->c0). 
k=0 k=0 
From (25), (26) and (30) it then follows that 
en ee 
E, ~ e” , (n---><e), 
k=0 (32) 
and 
ce 
E, ~ Oy (ec), 
k=0 (33) 


To asymptotically estimate the sum in (32) and (33), note the function 


2 


fC Ce 
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is positive and monotone decreasing on [0 , ). Setting 


we then have 








k 
(a ) aie 
f(kh) = e @ Caw 
and 
k,+1)b k, k pb 
f° fexydx s nfo) < f “fe ax. 
h k=1 0 
(34) 
Since 
k,>n? - 1, 
d k,h Kn it follows that 
an = , it follows 
: ¥2n 
re 
k,h > ——(n’ -1 
n A ) 
or 
| ceil 
k,h > —=(1-—=). 
Hence, ky h--->e2 and h--->0, as n--->09. 
Letting n--->c in (34), we conclude 
im 1) «es ee, Ed 
rm b= Len | f ca =F 
P40 ay - 
or 


_— 
i=] 
Pl. 
bho 
; 

>) 











e = ~ 7? (n--->00), 
k=1 (35) 
Equation (32), (33) and (35) then impliy 
¥2nn . Y¥2nn 
Je. aa 9) ’ es i 2 ’ oo) (36) 


B. THE ASYMPTOTICS OF THE EXPECTED TOTAL NUMBER OF 
DISTINCT BALLS 


In the first game considered above we defined Ty, to be the expected total 
number of distinct balls obtained before winning. Let p be the probability of 
winning the game, and q=1-p be the probability of losing. Recall that one 
wins the game if n distinct balls are obtained consecutively and loses 
otherwise. 

Let the random variable X be the number of times we play the game 
before winning. Then 


P(X=k) = pq*’, (k = 1,2,3....). 


The probability p of winning the game, ie., of getting exactly n distinct 
balls before a repetition, is p = pn = n!/n®*, by (2). 
The expected value of X is 


Ms 


kP(X=k) = > kpq*’ 
k=1 


k=1 
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O|- 


— 


aE 


This means that, on average, we must play n"/n! times in order to win. 
Therefore, the expected total number of distinct balls T, obtained before a win 
can be represented as follows : 


Te Ces 


n 


This is the value of T, because the expected number of plays is 1/p 
(=n"/n!). Among these plays, one must be a win, and furthermore that win 
must occur on the very last play. All the other plays are losses. When we win, 
we draw out n_ distinct balls, and when we lose, the expected number of 


distinct balls is E, Therefore, 


n 


T. Soe eae 
Pp (37) 


This expression can be rearranged as 


From (36), 





E ¥2nn BE ¥2mn 
Do 8 as aw 


So n- E, = O(n) , (n-—-->>-9). It follows that 


E, 
Ty = O(n) + D> 


Now consider Ej/p. Since 





E, ~ E,” , (n--->e9), 


we can write 


Ee ] Jee i 
— ~ ~(—+—) , (N--->0 
D as Jigcaal ) 
But 
1 | Sig ] 
ee (E+E 
p p p | a En 
an n-l oo 
= —(),a,+ dD By) 
k=0 k=0 


n 
@yi+tte et n-2 | , ol nd 
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1 n 
iv? we —) + (1+— + 
n n on n On n n+1 


(38) 
(39) 
Nn Nn 
ae) we 


n-1 n-2 n-3 n+1 n+2 
n n 


n n" n 
= HIME (GG Gn ee )+ Gr * Gab! * Grae? 


and the last expression, after rearranging, can be written as 


Z n-2 n-1 n n+] n+2 
Cee re JOE) (ey ) 
2! ~ (n-2)! (n-1)! nf! (n+l)! (n+2)! °" 
n 
= € ; 


It follows from (39) that 


| see e" 
=e en 


(40) 
With this information, letting n--->ce in (38) yields 
e” 
Ty ~ S , (n--->0). 
n 9) (n ) (41) 
C STIRLINGS’ FORMULA 
From (38), (40) and (41) 
T, 
~ —, (N--->0o° 
" ?P (42) 
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n 
T, ~—En » (n-->=), = 
Since 
E, ~ SEP | (nde) 
(43) implies 
n 
n ¥2nn 
Da ap aes 
Using (41), we get 
e _ ini ¥2nn =) 
9) 1 ue) as ; (44) 


or alternatively, 


n 
n 

n! ~ — ¥2nn , (n--->0). 
n 


¢ 


This can also be written as 
n -n 
n! ~ fh © ¥ 27tn ’ (n--->0°), 


and this is Stirling’s formula (1). 
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IV. CONCLUSION 


We have given a new combinatorial or probabilistic derivation of 
Stirling’s formula. Our derivation also gives another way to interpret 
Stirling’s formula. To see this, let us consider a specific value for n. Suppose 
n = 20, 1e., there are 20 distinct balls in the box. The expected number of 


distinct balls E29 obtained is 


E _ 1 429,19 18 19 1817 | EN 
20 ~ 20 © 20 20 © 20 20 20°" " 4919 
= 5.293584585. 


This is fairly close to the asymptotic value of En as n--->°9, i.e., 


4 27 (20) 


5 = 5.604991216. 


The probability of winning a game when n = 20 is 


40 


By (37), the expected total number of distinct balls T29 obtained before a 


win is 


T9 — 20 = ( 43099804 - ] ) (E49) 


228152473. (45) 
The asymptotic formula (41) for Ty gives, for n = 20, 
20 


Cc 
Ee 


242582598, 


u 


and this is of the same order as (45). Asn gets larger, the agreement between 
the exact formula for Typ and the asymptotic formula will get increasingly 
better. Notice that when n = 20 the expected number of plays before a win is 
quite large. 

To conclude, we can interpret Stirling’s formula as written in (44) in the 
following way using (42). As n--->eo the expected total number of distinct 
balls obtained before a win is asymptotic to the expected number of plays 


necessary to win times the expected number of distinct balls per play. 
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